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ABSTRACT 

This paper contends that much of the time and money 
devoted to standardized testing in the United States is misspent. Too 
many tests are poorly constructed, unreliable, and unevenly 
administered. Multiple-choice tests cannot measure thinking skills or 
real problem-solving ability. In addition, many examinations are 
biased racially, culturally, linguistically, and by social class and 
gender. Use of these flawed tests leads to inaccurate and 
inappropriate decisions for individual children and harms the entire 
educational system because standardized tests provide little useful 
information for educational improvement. The National Center for Fair 
and Open Testing (FairTest) urges changes in the use of tests to 
eliminate mass testing of young children for readiness, placement, 
and promotion. No decisions about a child should be made primarily on 
the basis of test scores and tests must be no more than one small 
part of an assessment. Valid and comprehensive unbiased alternatives 
must be developed. These themes are expanded on in the following 
sections: (1) "What's Wrong with Standardized Tests?''; (2) "Tests 
Used in K-12"; (3) "Better Options for Assessing Educat i on" ;' (A) 
"Alternatives in the States"; (5) "Excerpts from the Statement of the 
Campaign for Genuine Accountability"; and (6) "FairTest Goals and 
Principles." (SLD) 
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Fallout from the Testing Explosion 

America's public schools administer more than 100 million 
standardized exams each year, including IQ, achievement, screen- 
ing, and readiness tests. 

Much of the time and money devoted to testing is misspent. Too 
many tests are poorly constructed, unreliable, and unevenly admin- 
istered. Multiple-choice questions cannot measure thinking skills, 
creativity, the ability to solve real problems, or the social skills we 
want our children to have. Moreover, many exams are biased 
racially, culturally, linguistically, and by class and gender. 

Unfortunately, use of these flawed tests leads to inaccurate and 
inappropriate decisions about children's education. Minorities and 
low-income children are too often excluded from "gifted and 
talented" programs and placed in special education or "mentally 
retarded" classes, where they do not get a good education. Results 
of tests given to young children are particularly erroneous. 

Not only are individual children harmed, but so is "rhe entire 
educational system. Test scores provide little useful information to 
help improve instruction and students' learning. In pursuit of 
higher test scores, the curriculum has been narrowed and 
"dumbed-down" to match the tests. Children learn less. 

FairTest urges changes in the use of tests. First, mass telling of 
young children for readiness, placement and promotion must stop. 
Second, no decision about any child should ever be made primarih* 
on the basis of test scores. Third, tests must be no more than one 
small part of assessing both students and educational programs. 
Fourth, valid, comprehensive, and unbiased alternatives must be 
developed (see inside). FairTest urges political and educational 
leaders to support the use of assessment methods that will help 
improve learning and instruction in our nation's schools. 



Fallout from tfie Testing Explosion a 77 page manua 
researched by FairTest, explains each of the above points in 
detail with substantial supporting evidence. It includes the results 
of a FairTest survey on the extent of test use in the states and a 
comprehensive annotated bibliography on testing and 
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testing reform. 

Standardized Tests and Our Children: 
A Guide to Testing Reform, a 32-page manua 
available in English or Spanish, outlines the problems 
and solutions to standardized testing in a compre- 
hensive, yet easy-to-read format. The Guide is 
appropriate for parents, educators, and 
community organizers, and is priced at 
only $4 (bulk discounts available 

Use the form inside this Fact Sheet 
lo order your copies today. 




What^s Wrong with Standardized Tests? 



ARE STANDARDIZED TESTS HELPFUL EVALUATION TOOLS? 

No. K4ost standardized tests used in public schools have a multiple-choice or short-answer format in 
which each question has only one right answer. Instead of measuring the ability to think or create, they 
reward the ability to quickly answer superficial questions. They don't help teachers improve curricu- 
lum, instruction, and learning. They typically assume all test-takers have been exposed to backgrounds 
similar to those of test-developers: predominantly white and middle-class. 

ARE STANDARDIZED TESTS OBJECTIVE AND FAIR? 

The onlv objective part of most standardized tests is fhe scoring, which is done by machine. What items 
to include on the test, the wording and content of the items, the "correct" answers, how the test is 
administered, and the uses of the results are all decisions made by subjective human beings. 

ARE TEST SCORES "RELIABLE"? 

A test is completely reliable if you get exactly the same results each time you administer it. With all 
tests, an individual's score can vary greatly from day to day due to such factors as testing conditions, 
the test-taker's mental or emotional state, and w^hether a student has been coached. Test scores of 
young children are particularly unreHable. 

DON'T TEST-MAKERS REMOVE BIAS FROM TESTS^ 

Most test-makers review items for obvious biases, such as racially offensive words. But this is inadequate, 
since many forms of bias are not easy to detect. Some test-makers also use "statistical bias-reduction tech- 
niques" to locate biased test questions, How^ever, these techniques cannot identify underlying bias in the 
test's fom^ or content, hi fact, they assume the test as a whole is unbiased, which may not be the case. 

DO TESTS REFLECT WHAT WE KNOW ABOUT HOW STUDENTS LEARN? 

\o. Standardized tests are based on incorrect psychological theories from the early 1900s. While our 
understanding of how people learn and think has progressed enormously, tests have remained the 
same. The psychological theory on which tests are based — behaviorism — 

assumes that knowledge can be broken down into separate bits and that people 
learn by simplv absorbing the bits of information provided to them. Today, 
^ \v cognitive and developmental psychologists understand that people learn 
^J^^ \^ connecting what they already know v/ith what they are trying to 

learn. If they cannot actively make meaning out of what they are 
doing, they do not learn or remember very well. But most 
standardized tests are still based on narrow skills and 
remembering isolated facts. 

WHAT'S THE RESULT OF 

STANDARDIZED TESTING? 

Relying on test scores contributes to harm- 
ful practices such as grade retention and 
tracking. Retention, commonly referred 
to as "being held back," keeps a student 
in the same grade for an additional year. 
Research has proven this usually hurts the 
student's educational progress. Tracking sepa- 
rates students in classes, programs, or schools 
according to their "abilities." A student usually stays 
ith a group throughout the school years. Students in 
er tracks usuallv receive an inferior education. 




Tests Used in K-12 



Despite their inaccuracies, limited capacity to measure academic achievement or ability, and other flaws, schools 
often use standardized tests to determine if children are ready for school, track them into instructional groups, 
diagnose for learning disabilities, retardation and other handicaps, and decide whether to promote, retain, or 
graduate many students. Schools also use tests to guide and control curriculum content and teaching methods. 
This is despite the fact that no test is good enough to serve as the sole or primary basis for these important 
educational decisions. 



READINESS TESTS 

These tests, used to determine if a 
child is ready to enter school have 
been found to be highly inaccurate. 
On the basis of faulty tests, too many 
boys and girls are barred from enter- 
ing school, inappropriately placed in 
sp)ecial education, or improperly 
held back. These practices often lay 
the foundation for poor school 
performance and dropping out of 
school in later years. 

Also, because too many schools 
"teach to the tests," their use encour- 
ages narrowly academic classrooms 
that are inappropriate to the emo- 
tional social and mental develop- 
ment of young children. 

Black children, children from 
low-income families and children 
from homes where English is not the 
first language suffer most, because 
readiness tests often include cultural 
and language biases that result in 
lower test scores. 

SCREENING TESTS 

Used to detect disabilities and other 
problems, these tests are often not 
adequately validated. That means 
there is no clear proof they accu- 
rately measure what they claim to 
measure. While screening tests are 
supposed to be used to refer children 
for further diagnosis, they often are 
misused to place children in special 
programs. They also promote a view 
of children as having deficits to be 
corrected, rather than having 
individual differences and strengths 
on which to build. 



ACHIEVEMENT TESTS 

During the 1970s and 80s, the 
pressure for students to attain high 
test scores on standardized, mul- 
tiple choice achievement tests 
increased tremendously. 

Achievement tests, however, 
seldom measure what they are said 
to measure. For exam.ple, multiple- 
choice reading tests actually 
measure a limited range of "read- 
ing skills/' rtot the ability to 
understand and use printed 
materials. 

These tests also only measure a 
narrow range of knowledge. Where 
raising scores has become the major 
goal of education, a school's 
curriculum is "dumbed-down." 
Classrooms become test coaching 
centers; months of class time are 
spent trying to prepare students to 
score high. TTiis discourages 
children's enthusiasm for learning 
and undermines the opportunity to 
develop higher order thinking 
abilities and apply or create 
knowledge. As a result, children 
are not adequately prepared 

Achievement tests also 
tend to be biased in terms 
of culture, background, 
and language. Too often, 
schools use test scores of 
children from minority and low 
income families to label and track 
them into "slow," "learning 
disabled," or "remedial" classes, 
creating a self-fulfilling prophecy: 
those who are not expected to 
learn, don't. 



IQ TESTS 

These tests assume 1) "intelligence" 
can be measured; 2) "intelligence" 
is fixed; and 3) "intelligence" is a 
single entity. However, there is no 
agreement on any of these beliefs. 
In fact, studies have shown that IQ 
scores can be changed by training, 
nutrition, or simply by having 
more friendly people administer 
the test. In reality, IQ tests are 
achievement tests which primarily 
measure knowledge of standard 
English and exposure to certain 
middle-class experiences. 





Excerpts from the Statement of the Campaign 
for Genuine Accountability in Education 

The folhwiui^ ore excerpt from the Statement of the Cnmpni^u for Genuhie Accowiiahilit}/ in 
Etiiicotiou. n conlitm of orj^nuizntms and individuals dedicated to improvm^ the assessment and 
education ofyoim^ chihiren, founded by ¥ airiest. 

It is crucial that political and education officials, at all levels, recognize 
that standardized, rnultiple-choice tests are not an adequate means to 
measure educational progress, nor are high test scores an appropriate 
educational goal. There are educationally sound means of evaluation 
which can provide a basis for improving teaching, informing the public, 
and measuring progress, thereby providing genuine accountability. 

The states, local districts, and the federal government should embrace 
the goal of moving away from reliance on standardized multiple-choice 
test scores and towards use of alternative, authentic, and appropriate 
methods of assessing educational performance and progress. In doing so: 

• Education and political leaders should call for the use of appropri- 
ate and authentic evaluation in classrooms and to assess aggregate 
student achievement and progress; they should call for their states 
and local districts and federally funded programs, such as Chapter 
I, to implement available alternative assessment measures and continue 
to develop new ones for use in evaluating students and programs. 

• These leaders should not call for raising standardized test scores as 
a goal of educational reform; should not call for new or additional 
testing with standardized, multiple-choice exams; should not rely 
on existing standardized tests as indicators of educational progress; 
and should not depend on standardized tests to make decisions 
about program placements... 

Political and educational leaders at all levels should set a timetable 
for phasing out most uses of standardized, multiple-choice tests and 
replacing them with reliable, valid, and educationally appropriate 
alternatives. Before the implementation of alternatives, use of and 
reliance on standardized multiple-choice tests should be reduced as 
much and as quickly as possible. 



Education Week 

Coalition Implores Bush, Governors 
To Avoid Use of Standardized Tests 
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By Robert Rothman 

Washington— Charging? that an empha- 
sis on multiple-choice tests could "under- 
mine many of the educational reforms 
which the governors and President Bush 
wish to achieve." a coaHtion of three dozen 
education and civil-rights groups last week 
urged those leaders to use alternative fomns 
of assessment to measure progress toward 
O jonal goals. 

n a statement released here, the groups 
■firtpd that "RtMnHarHi^pH miiltinlp« 



choice tests are not an adequate means to 
measure educational progress, nor are high 
test scores an appropriate educational 
goal" 

"Other, educationally sound means of 
evaluation exist/' the statement continues, 
"and can provide a basis for improving 
teaching* informing the public, and mea- 
suring progress, thereby providing genuine 
accountability." 

The groups urged the governors to "set a 
timetable" for phasing out their states' ex- 
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Better Options 
for Assessing Education 

Performance assessment — also called "authentic/' "appropriate/' 
or "alternative" assessment — directly measures educational achieve- 
ment in the subject area. That is, it looks at actual student work. With 
young children, authentic assessment is often referred to as "develop- 
mentally appropriate." 

Perfom^ancG assessments employ a v/ide variety of techniques: 
written products, experiments, exhibitions, performances, portfolios of 
work, and teacher observations of regular classroom activity. They can 
be used to assess individual w^ork and cooperaHve group projects. 

The most widely used authenhc assessment in educahon today is 
in writing. For example, many states ask students to write on assigned 
topics. Tne essays are graded by teams of trained readers who assign 
scores according to standard guidelines. The readers are trained and 
retrained throughout the process to maintain reliable standards. 

Similar techniques are being used to create open-ended mathemat- 
ics questions in which students must show how they worked out a 
problem's solution. Authentic social studies assessments include tasks 
which allow students to demonstrate they grasp important concepts 
about history or government. Foreign language assessments require 
students to use the language in real-life situations, orally and in print. 

In order for these and similar assessments m reading, science, and 
other subjects to be most helpful, they should be integrated loith the 
curriculum. Teachers can use assessment results to help determine 
students' needs and improve instruction. Students also learn to assume 
responsibility for their learning, and through the use of portfolios, 
engage in regular self-analysis of their work and progress. Performance 
assessments that provide documentahon of a student's work over time 
can provide better information than standardized tests. 

Authentic-assessment information can be sunmiarized numerically 
or put on a scale. Individual results can be combined to provide a 
' O^^^^^^''^-..,^^^ variety of information about overall performance at the 

^ classroom, school, district, state, and national levels. 

At this time, however, educators are still 
learning how to use large-scale 
performance assessments 
reliably and fairly. Use of 
these assessment tools 
assumes major changes in 
curriculum and instruction in 
our schools. Since teachers 
become the primary assessors, 
they must receive the training 
necessary to use these new 
assessments. Outside participation 
by trained people can help ensure 
that racial or cultural bias does not 
distort the assessment process. 




in the States 

Many states have begun explor- 
ing — and implemenhng — 
better forms of assessment as 
alternatives to multiple-choice 
tests. For example: 

ARIZONA has begun to use 
performance-based tests at grades 
3, 8 and 12 in reading, Vv^riting 
and math. 

CALIFORNIA implemented the 
California Writing Program, 
started on alternative math 
assessments, and is experiment- 
ing in social studies and science. 

COxNNECTICUT is developing 
performance-based science and 
math assessments inihated by a 
multi-state consortium and the 
Coalition of Essential Schools 
under a grant from the Nahonal 
Science Foundahon. 

KENTUCKY plans to use prima- 
rily performance assessments in 
its new state assessment program. 

NEW YORK has a 4th-grade 
science manipulation skills test 
and plans to change its Pupil 
Evaluation Program to emphasize 
portfolios, teacher evaluations 
and open-ended testing. 

NORTH CAROLINA banned 
the use of standardized achieve- 
ment tests in grades 1 and 2 and 
introduced assessments relying 
on teacher observahon of class- 
room acrivity. 

VERMONT is piloring the use of 
portfolios in grades 4 and 8 in 
math and w^riting. 

MANY STATES use perfor- 
mance measures in some grades 
as part of statewide testing. 
Twent\'-eight states include 
w^riting samples, for example. 
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FairTest Works for Testing Reform 

The National Center for Fair & Open Testing (FairTest) was 

founded at a 1985 conference which brought together 40 leaders of 
national education, civil rights, consumer, research and student 
organizations. Though all the groups were gravely concerned about 
the growing impact of standardized exams, none had the resources 
to make testing reform a top priority. 

These key activists agreed their isolated testing reform cam.paigns 
could be enhanced by the increased visibility and coordination that 
would come from a new^ national organization. The result was FairTest. 

Contribute to FairTest 

How can you be part of the rapidly expanding movement to subject 
standardized tests to public scrutiny? Support the National Center for Fair 
& Open Testing, the only organization devoted exclusively to reforming 
testing in education and employment. 

• For just $25, you can become a FairTest Associatl and receive a 
subscription to the FairTest Examiner, the quarterly source of accurate 
and independent news about standardized testing advocacy and 
research. 

• Become a FairTest Sponsor for S50 and you'll get a I ..irTest Examhwr 
subscription and a complimentary FairTest publication. 

• Contributors of $100 or more receive all the above plus a 207c publica- 
tions discount, and become FairTest Sustainers. 



/ agree there's no better way to be part of the testing reform movement 
than by supporting FairTest! Enclosed is my tax-deductible contribution. 



3 FairTest Associate 

3 FajrTest Sponsor 

3 FairTest Sustainer 

3 Other 



($25 — includes a free subscription to the Examiner) 

($50 — includes Examiner and free publication) 

($1 00 or more — includes above plus a 20% discount 
on all publications) 



Publications: Fallout from the Testing Explosion 

Standardized Tests and Our Children 
FairTest Examiner 
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^ Please make checks payable to FairTest, 342 Broadway, Cambridge, MA 021 39 
(Contributions to FairTest are fully tax-deductible, except for the value of the publications. | 



FairTest Goals 
& Principles: 

Hie National Center for Fair & Open Testing 
( FairTest), an advocacy organization, works 
to end the abuses, misuses, and flaws of 
standardized testing and to make certain 
that evaluation of students and workers is 
fair, open, accurate, accountable and edu- 
cationally sound. The organizolion was 
founded in 1985 on these basic principles: 

1 . TESTS SHOULD BE FAIR AND VALID. 

Tests should provide equal opportunity, 
rather than favor individuals on the basis of 
race, ethnicity, gender or income level. 

2. TESTS SHOULD BE OPEN. Indepen 
dent researchers should have greater access 
to testing data, including evidence of test 
validity and reliability. 

3. TESTS SHOULD BE VIEWED IN 
THEIR PROPER PERSPEGIVE. Safe 
guards must be established to ensure that 
curricula are not driven by standardized 
testing and that test scores are not the sole 
criterion by which major educational and 
employment decisions are made. 

4. ALTERNATIVE ASSESSMENT 
INSTRUMENTS MUST BE DEVELOPED. 

New methods af evaluation t^'at fairly and 
accurately diagnose thestrenglhsand weak- 
nesses of students, workers and programs 
need to be designed and Implemented. 

Jo accomplish its goals, FairTest is involved 
in the following activities: 

\ . PUBLIC EDUUTION. FoirTest serves 
as an important source of information about 
testing and alternatives for educators, par- 
ents, public officials, journalists and other 
policymakers. 

2. TECHNICAL ASSISTANCE. FairTest 
provides information, troining and strategic 
advice to parents, educators and a brood 
range of civil rights and women's organiza- 
tions. FairTest also convenes conferences to 
discuss joint work and strategies. 

3. ADVOCACY. FairTest coordinates and 
catalyzes educators, citizen groups and par- 
ents to bring about needed testing reforms. 
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